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ABSTRACT 

The most stringent constraint on the so-called effective electron neutrino mass from the 
present neutrinoless double beta decay experiments is \M ee \ < 0.2 eV, while the planned 
next generation experiment GENIUS is anticipated to reach a considerably more stringent 
limit \M ee \ < 0.001 eV. We investigate the constraints these bounds set on the neutrino 
masses and mixings of neutrinos in four-neutrino models where there exists a sterile 
neutrino along with the three ordinary neutrinos. We find that the GENIUS experiment 
would be sensitive to the electron neutrino masses down to the limit m Ue < 0.024 eV in 
such a scenario. 
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There exist strong experimental indications that neutrinos have mass and that they 
mix. The results of the Super-Kamiokande experiment |1] on neutrinos produced in 
Earth's atmosphere by cosmic rays provide a convincing evidence of neutrino oscillations, 
and the results of the solar neutrino experiments point to the same direction. Results 
from the laboratory experiment by the LSND collaboration || may also be an indication 
of neutrino oscillations but they still await a future confirmation, e.g. at the MiniBoone 
and 1216 experiments |4j], in particular so because measurements in KARMEN detector 
H exclude most of the region in the parameter space favoured by the LSND. 

Neutrino oscillation probabilities are determined by squared mass differences Sm^ = 
m 2 — mf, where rrii is the mass of the massive neutrino state z/j, and the elements of the 
neutrino mixing matrix U that connects the massive neutrino states Vi and the flavour 
neutrino states v a through the relation v a = Yli^ai^i- For explaining the solar and 
atmospheric neutrino data two mass-squared difference scales, 5m 2 tm ~ 10~ 3 — 10~ 2 eV 2 
for atmospheric neutrinos and 5m 2 un ~ eV 2 or ~ 10~ 10 eV 2 for solar neutrinos, are 
needed, and the data can be described within a three-neutrino model. If the LSND result 
is not disregarded, a three-neutrino framework is not sufficient but one has to go beyond 
it and consider a model with four (or more) neutrinos as three different levels of mass- 
squared differences are needed, the third one being 5m 2 SND = 0.3 — 2 eV 2 . In addition to 
the three known neutrino flavours v e , and v T one has to incorporate at least one light 
neutrino v s that is sterile, i.e. it lacks Standard Model (SM) gauge interactions ||. 

As was pointed out in ref. [7J, the only four-neutrino mass patterns that are consis- 
tent with all oscillation data are those where there are two pairs of neutrinos with close 
masses, the "sun-pair" (mass states vq and v{) and "atm-pair" (mass states v-i and v$) 
corresponding to the squared-mass differences Sm 2 tm and Sm 2 un , respectively, separated 
by a gap corresponding to Sm1 SND • 

Another oscillation constraint follows from cosmology. Depending on the value of 
5m 2 , a large active- neutrino mixing could bring sterile neutrinos into thermal equilibrium 
thereby increasing the effective number of light neutrinos ||, N u , which would affect the 
big bang nucleosynthesis (BBN). This leads to quite tight constraints on the active-sterile 
mixings §-0. 

In the case neutrinos are Majorana particles ||12|| , which is quite likely from the theoret- 
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ical point of view, another useful source of experimental information on neutrino masses 
and mixings is provided by the neutrinoless double beta (0z//3/3) decay. The Qv(3(3 decay is 
sensitive to the values of the neutrino masses themselves, in contrast with the oscillation 
data which depend only on the squared-mass differences. Also, it provides information on 
the Majorana CP-phases of neutrinos, to which the oscillation phenomena are practically 
insensitive. In the present work we shall study the constraints the 0z//3/3 decay places 
on the neutrino masses m.j, the neutrino mixing matrix U and the relative CP-phases of 
neutrinos in four- neutrino models consisting of three active neutrinos u e , and v T and a 
sterile neutrino v s with the 2+2 mass pattern described above. 

The quantity probed in the Qv(3(3 decay experiments is the absolute value of the 
effective mass 

M ee = ^m,C4 (1) 

i 

The most recent experimental upper bound for it from the Moscow-Heidelberg experiment 
is (at 90% C.L.) @ 

|M ee |<0.2eV. (2) 

In turns out that this bound is in the case of four-neutrino models less restrictive than 
in the case of the tree- neutrino models ||14||. A substantial strengthening of the present 



bound is, however, foreseen in the future. In the planned GENIUS experiment one expects 
to reach after the first year of operation the limit 0.01 eV and eventually the limit [|Tj| 

\M ee \ < 0.001 eV (GENIUS). (3) 

We will study the restrictions this bound would set on the parameters of four-neutrino 
models, in particular on the mass of the electron neutrino v e and the mixing of v e with 
and u T . 

The constraint from the Ov/3/3 decay is sensitive to the relative CP-phases rji of the 
mass states z^. We will concentrate in the CP-conserving case where rji = ±1. In this 
case one can write (Q) in the form [|l6|j 

M ee = J2v l m\U ei \ 2 . (4) 
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The most general mixing matrix U that describes the connection between the flavour 
states u s , z/ e , z/^, v T and the Majorana mass eigenstates z^o, U\, U2, vz can be parametrized 
in terms of 6 rotation angles and 6 phases as follows (see, e.g., ref. flPTl ): 



/ 
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where Cjf. = cosOjk and Sjk = sin ifc e^*. For our discussion relevant is the second 
row which gives the composition of the electron neutrino in terms of the mass eigenstates 
neutrinos. It depends on several mixing parameters but fortunately simplifies considerably 
when the existing constraints from laboratory experiments and cosmology are taken into 
account. 



Assuming the 2+2 mass hierarchy among neutrino masses, indicating 5m, 



02 



5m, 



03 



5m\ 2 _ u,, n3 
ability P{y e - 



5m 2 ^ ~ 5m 2 LSND , the Bugey short baseline experiment [IS|, measuring the prob- 
v e ) ~ 1 - A ee sin 2 (L5ml SND /AE), yields the bound |7| 



4(|C/ e2 | 2 + |?7 e 3| 2 )(l-|?7 e 2| 



\U, 



< 3 1 



< 0.06, 



(6) 



or 



|Cq2Ci3S^ 2 — S 02 S 03 S 13| 2 + I C 03 S 13| 2 < 0.016. 



(7) 



4 



The angles 9 02 and 9 03 are further constrained by the big bang nucleosynthesis (BBN) 
as large mixings would, as mentioned above, increase the number of the effective degrees 
of freedom N u by bringing the sterile neutrino into thermal equilibrium. According to a 
recent analysis [IT], the two-flavour v T)li <-> v a mixings should obey the constraint (valid 



for \5m 2 \ < 2.5 • 10 3 eV 2 ) 

|<W|sin 2 fl < 7- 1(T 5 eV 2 (8) 

in order not to lead to a conflict with the BBN limit N v < 3.2 [1J|. Since now 5m 2 = 
5m 2 SND = 0.3 — 2 eV 2 , the mixing angle 9 should be < 1CT 2 , and it is therefore conceivable 
to assume s 2, % ^ 1. With this approximation one derives from (|7|) the bounds 

b = sin 2 9 X2 + sin 2 9 13 < 0.016, 
|6'| = | sin 2 9 12 -sin 2 9 13 \ < 0.016, (9) 

and the following approximative composition of the electron neutrino in terms of the mass 
eigenstates: 

v e = - sm9 01 e i5oi u - cos^i + sin9 12 e l5l2 u 2 + sm9 13 e i5l3 u 3 . (10) 

Let us note that the cosmological argument used above remains still somewhat contro- 
versial. Some analysis allow for the number of the relativistic degrees of freedom, instead 



of the bound N v < 3.2 quoted above, values close to four f20fl , in which case BBN would 
not place any constraint on the angles s 2, s 03 . The difference is due to conflicting results 
on the primordial deuterium abundance. Furthermore, the BBN constraint depends on 
the lepton asymmetry in the early universe, which might considerably weaken the bounds 
[ pTf (in the case the predominantly sterile mass eigenstate is lighter than its active mixing 
partner). Anyhow, we will assume in the following that the sterile neutrino mixes consid- 
erably only with the electron neutrino and consequently that the approximations (0) and 
( [TD[ ) are va hd. 

In this approximation the solar neutrino oscillation is described entirely in terms 
of the angle #oi associated with the u e «-> v s mixing. According to an overall anal- 
ysis of all solar neutrino data, only the small angle matter solution (SAMSW) with 
2 • 10~ 3 < sin 2 26*01 < 10~ 2 leads to a reasonable fit in the active-sterile mixing case |22|] . 



There are two mass patterns consistent with the oscillation data, differing in as to 
which one of the pairs, the sun-pair or the atm-pair, is lighter. We will call Model A the 
pattern where the sun-pair is the light one and the atm-pair is the heavy one, and the 
case where the mass order is the opposite will be called Model B. The mass scale of the 
lighter neutrino pair is denoted by m, and the mass gap between the pairs is denoted by 
Am, so that the mass scale of the heavier pair is m + Am. We will neglect the mass 
differencies inside the two pairs by assuming they to be small as compared with the mass 
gap Am. 

Studies of the anisotropies of the cosmic microwave background radiation and the 
large scale structure of the universe provide information on the sum of neutrino masses, 

"V — 4m + 2 Am. The contribution of neutrinos on the dark matter content of the 
Universe is in units of the critical density given by Q u = h~ 2 m^/94 eV, where h is the 
dimensionless Hubble constant (Hq = 100 h km s _1 Mpc -1 ). In the previously popular 
hot+cold dark matter scenario |?3| the neutrino contribution to the energy density of 
the universe is assumed to be Q u ~ 0.2, but the more recent observations, indicating 
the existence of a large cosmo logical constant, imply that this should be taken as a 
conservative upper limit only [23]. With the recent measured value of the Hubble constant 
[ p5| , h ~ 0.71, this leads to the upper limit J2i m n ~ 10 e V. Recently it has been claimed 
that this limit improves to 

^m^<5.5eV (11) 



when the information from the Lya forest in quasar spectra is taken into account 

The range of the squared mass difference, ^^lsnd = 0-3 — 2 eV 2 , indicated by the 
LSND data and allowed by the Bugey and the other short baseline experiments yields the 
following upper and lower bounds for the mass difference Am as a function of the mass 
m: 

-m + Vm 2 + 0.3 eV 2 < Am < - m + \/m 2 + 2 eV 2 . (12) 
Combining this with the cosmological bound (|TTD leads to the following bounds on m and 
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Am: 

m < 1.3 eV 



Am ~ > 0.1 eV. (13) 

In the extreme case of m = 1.3 eV and Am = 0.1 eV the mass spectrum is quite degenerate 
with m — mi ~ 1.3 eV and m 2 — m 3 ~ 1.4 eV (Model A) or m — mi ~ 1.4 eV and 
m2 — m 3 ~ 1.3 eV (Model B). At the other extreme of m = 0, i.e. when the lighter 
neutrino pair is massless, the heavier neutrino pair would have its mass in the range 0.5 
eV to 1.4 eV. 

Let us proceed to examine the consequences of the constraints (|2|) and (|3|) on the 
neutrino masses and mixing angles 0qij $12 and # 13 for different CP-phase patterns 
(770, 771, 772, 773) in the two models A and B. 

Model A. In this model the neutrino pair (z/ ,^i) responsible for the solar anomaly 
is lighter than the pair (u 2 , z/3) responsible for the atmospheric neutrino anomaly, i.e. the 
mass spectrum is of the form 

m — mi = m 

m2 ~ m 3 = m + Am. (14) 

The 0i>(3f3 condition takes in this case the form 

|m(77 sin 2 #01 + r/i cos 2 #01) + (m + Am) (772 sin 2 6>i 2 + r/ 3 sin 2 6>i 3 )| < a, (15) 

where for the present experimental bound a = 0.2 eV and for the anticipated future bound 
of the GENIUS experiment a = 0.001 eV. In order to find out the consequences of this 
condition one should examine separately the following different patterns of the relative 
CP-phases 77 = (r/ , 771, r/ 2 , 773): 

I, II 77 = (1,1,±1,±1), 

III, IV 77 = (1,1,±1, T 1), 
V,VI 77 = (1,-1,±1,±1), 

VII, VIII 77 = (1,-1,±1, T 1). (16) 
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In the first four cases (I- IV), where i]q = rji, the Ovftft condition is not affected by the 
solar neutrino mixing angle #01 ■ 

In Cases I and II the 01/(3 (3 condition ( |ToD becomes 

|m ± (m + Am)b\ < a (17) 

where the plus-sign corresponds to Case I and the minus-sign to Case II, and b = sin 2 Qyi + 
sin 2 6*i3, as defined in eq. 

Case I. The LSND and other short baseline experiments constrain the value of the mass 
gap Am between the two neutrino pairs within the range given in eq. (0). Combining 
this with the cosmological lower bound (|13|) yields for Am the allowed range from 0.1 eV 
to 1.4 eV. One then concludes from (|I7]) that with the present experimental sensitivity 
the 0uf3j3 result does not set any constraint on the mixing angles #12, #13 as bAm <C a. 
The experimental constraint implies just an upper limit for the mass scale m, m < (a — 
bAm)/(l + b) ~ a = 0.2 eV. 

The situation would be different in the case of the anticipated GENIUS bound a = 
0.001 eV. The condition ([L7]) to be satisfied one must now have b < a/ V0.3 eV ~ 2a/eV = 
0.002 , which would mean tightening of the present bound @ from the Bugey reactor 
experiment by one order of magnitude. Also the allowed values of m are relatively small, 
m < a = 0.001 eV. 

Case II. The Case II does not differ from Case I in any essential way as far as the 
present 0v(3j3 bound is concerned. With the GENIUS bound the upper limit of the mixing 
angles 6 I 12 ,6 I 1 3 is as stringest b < a/\^3 eV ~ 2a/ eV = 0.002 obtained for m = 0. The 
situation is different compared with Case I in that now the condition (|T7| ) imposes also 
a non-zero lower limit on b when m > a, otherwise there would not be sufficient cancel- 
lations among the varios terms to make the condition flT5| ) to be valid. The quantity b 
would be constrained into the range (m — a)/ y/m 2 + 2 eV 2 < b < {m + a) / \Jm 2 + 0.3 eV 2 , 
where the upper limit is overtaken by the upper limit b < 0.016 from the short baseline 
experiments, when m > 0.008 eV. The sensitivity range of the GENIUS experiment in 
the (m,b) parameter plane is presented in Fig. 1 (solid line). As can be read from the 
figure, the GENIUS experiment would in this case be sensitive to the values of m down 
to 0.024 eV. 
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Figure 1: The sensitivity range reached by the planned GENIUS experiment in the mass pa- 
rameter m and the mixing angle variables b = sin 2 O12 + sin 2 #13 and b' = sin 2 9\2 — sin 2 #13 
in Model A. The upper and/or lower bounds of ±0.016 for b and b' are obtained from Bugey 



experiment [18]. The area bounded by the dashed line illustrates Cases I (b as vertical axis) 
and III [b 1 as vertical axis) (see eq. (|l~6|) ) whereas the area bounded by solid line illustrates the 
sensitivity range in Cases II (6) and IV (6'). Cases V-VIII are related to Cases I- IV in a way 
described in the text. 

Cases III and IV. In Cases III and IV the 0i//?/3 condition ( |T5| ) becomes 

\m ± (m + Am) 6' I < a, (18) 

where the plus-sign corresponds to Case III and the minus-sign to Case IV, and b' = 
sin 2 6*12 — sin 2 # 13 , as defined in (^). Just like in Cases I and II, the present Ois/3/3 bound 
does not probe the mixing angles 812 and #13 but sets a constraint merely on the mass m. 
Again, the GENIUS experiment would be sensitive to the values of these angles. In Case 
III the condition (18) restricts the allowed values of b' = sin 2 # 12 — sin 2 # 13 , whose value 
is by other constraints limited to —0.016 < b' < 0.016, so that for example for m = 
only the values \b'\ < a/V0.3 eV ~ 2a/eV = 0.002 are allowed. The condition (|T8|) is 



never satisfied for the mass values m > 0.024 eV. This would be the sensitivity limit of 
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the GENIUS on the electron neutrino mass also in this case. The allowed values of b' 
are negative, (— m — a)/\/m 2 + 0.3 eV 2 <b'< (— m + a)/\/m 2 + 2 eV 2 , except that for 
m < a small positive values are also possible. The GENIUS sensitivity range for this 
case is presented in Fig. 1 with the dashed line. Case IV is a mirror image of Case III 
so that again for m = all values \b'\ < a/V0.3 eV are possible, but now b' can have 
mainly positive values: (m — a)y/m 2 + 2 eV 2 < b' < [m + a)/\ / m 2 + 0.3 eV 2 (the solid 
line in Fig. 1). Note that this is almost the same region that was obtained in Case II for 
the quantity b. The limit that the GENIUS experiment could reach for the mass m is 
again 0.024 eV. 

Cases V and VI. In these cases the 0v(3/3 condition depends also on the solar mixing 
angle 9qi- 

|m(sin 2 6»oi - cos 2 9 m ) ± (m + Am)b\ < a , (19) 

where the plus-sign corresponds to Case V and the minus-sign to Case VI. If only the small 
mixing angle (SMA) MSW solution is being considered, one can use the approximative 
value sin 2 # i — cos 2 #oi ~ ±1, where the sign depends on whether #oi is close to or n/2. 
If one assumes that angle #oi — 0, condition (|i~9D becomes 

| - m ± (m + Am)b\ < a. (20) 

As is apparent from eqs. (|T7| ) and (^3), the 0^/3/3 constraints in Cases II and V are in 
practical terms the same, and no separate treatment is needed for Case V. The same 
applies to Cases I and VI. On the other hand, if the angle #oi is close to ir/2, condition 
( |20|) must be replaced with 

\m ± (m + Am)b\ < a . (21) 

and clearly Cases I and V as well as Cases II and VI correspond to each other as far as 
the Ovftft constraint is concerned. 

It is noteworthy that the values of 6*oi close to and close to n/2 correspond here 
two physically distinct situations while in oscillation experiments, where transition prob- 
abilities depend on # i through sin 2 2# i, do not make any difference between the ranges 
< 0oi < and vr/4 < 0„i < tt/2. 
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Cases VII and VIII. These cases are practically identical to Cases III and IV. If #01 — 0, 
the Qv(3(3 condition (|I5|) takes the form 

\ - m±(m + Am)b'\ < a, (22) 

where the plus-sign corresponds to Case VII and minus-sign to Case VIII. Comparison 
between eqs. ( [TBD and ( p2]) shows that in Cases IV and VII as well as in Cases III and 
VIII the 0^/3/3 condition is practically the same. If #01 — 7r /2, the same applies to Cases 
III, VII and IV, VIII. 

Model B. In this model the mass spectrum is of the form 

mo — mi = m + Am 

ni2 — rri3 = m. (23) 

Again we assume that mixing of the neutrino pair (i/ , Ui) is mainly responsible for 
the solar neutrino anomaly and mixing of the pair (^2,^3) for the atmospheric neutrino 
anomaly. The Qv(3f3 condition becomes now 

|(m + Am) (770 sin 2 6 m + r/i cos 2 #01) + m(rj 2 sin 2 8 12 + r] 3 sin 2 6>i 3 ) | < a. (24) 

If LSND results are taken into account and one assumes that 0.3 eV 2 < m 2 — m\ < 2 eV 2 , 
which yields ni\ > 0.5 eV, it is easy to see that eq. (^) is not realized for any value of m 
[p7| . This is because the absolute values of b and b', defined in eq. (|S|), are much less than 



1 770 sin 2 #01 + r/i cos 2 ^01 1 — 1) so that eq. ( P^D can be written approximately as 

\m + Am\ < a , (25) 

which is untrue because |m + Am\ = ni\ and even the present value of a is less than the 
lower limit 0.5 eV of m\. If we, on the other hand, disregard the LNSD results and let 
Am be as low as 0.1 eV, with present value of a we get some restrictions on the parameter 



values from eq. (|24|). Eight different rj combinations (|16D are in principle possible also 
in this case but because (as was already mentioned) the term proportional to b or b' in 
eq. (^4j) is much smaller than the term proportional to angle #01 , it can safely be neglected. 
So, the approximative equation ( p5|) is valid in every case, not depending on the choices 
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of 7] and 771 or whether 9 m is ~ or tt/2. The allowed values for m are in the range 
m < a — Am. 

We can summarize our results as follows. In the model A, i.e. when the neutrino 
pair (with mass m) responsible on the solar neutrino deficit is lighter than the neutrino 
pair (with mass m + Am) responsible on the atmospheric neutrino anomaly, the 0vf3f3 
constraint set by the future GENIUS experiment, M ee < 0.001 eV, induces an upper 
limit for mass m as a function of the quantity b = sin 2 # 12 + sin 2 # 13 or the quantity 
b' = sin 2 #12— sin 2 # 13 depending on the pattern of the relative CP numbers of the neutrinos. 
There exists eight possible patterns of the relative CP numbers, Cases I to VIII, defined 
in eq. ([16]). In Case I, where all relative CP numbers are equal, and no cancellations 
between the contributions of different neutrinos hence occurs, the upper bound for m is 
the stringest, m < 0.001 eV. For all the others Cases the absolute mass bound is about 
an order of magnitude less stringent, m < 0.024 eV. In Case I the value of b must be 
small, b < a. In the other Cases the restriction on b or b' depend on the value of m (see 
Fig. 1), and both a lower and an upper limit are obtained. For m < 0.08 eV the foreseen 
upper limit for 6 or \b'\ is more stringent that the limit of the Bugey experiment. There 
is a crucial difference between the different relative CP number patterns as comes to the 
ensuing limitations on the mixing angles #i 2 and #13, as a bound on b implies a bound 
on the both angles whereas a bound on b' implies only a bound on the difference of the 
angles, not on each of the angles separately. Also, the smaller is the mass m, the smaller 
or the more degenerate are the angles #12 and #13, depending on whether the obtained 
bound is on b or b', respectively. 

The Model B, i.e. when the neutrino pair responsible on the solar neutrino deficit is 
heavier than the neutrino pair responsible on the atmospheric neutrino anomaly, is in 
practical terms ruled out already by the present limit of M ee < 0.2 eV. 

This work has been supported by the Academy of Finland under the project no. 40677. 
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